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Abstract —Despite the deleterious effect of hardware impair¬ 
ments on communication systems, most prior works have not 
investigated their impact on widely used relay systems. Most 
importantly, the application of inexpensive transceivers, being 
prone to hardware impairments, is the most cost-efficient way 
for the implementation of massive multiple-input multiple-output 
(MIMO) systems. Consequently, the direction of this paper is 
towards the investigation of the impact of hardware impairments 
on MIMO relay networks with large number of antennas. Specif¬ 
ically, we obtain the general expression for the ergodic capacity 
of dual-hop (DH) amplify-and-forward (AF) relay systems. Next, 
given the advantages of the free probability (FP) theory with 
comparison to other known techniques in the area of large 
random matrix theory, we pursue a large limit analysis in terms 
of number of antennas and users by shedding light to the behavior 
of relay systems inflicted by hardware Impairments. 

I. Introduction 

Since the publication of the seminal papers of Telatar and 
Foschini m, m, showing the linear growth of the channel 
capacity by increasing the number of transmit and receive an¬ 
tennas, multiple-input multiple-output (MIMO) systems have 
attracted a tremendous interest. Especially, the demand for 
a thousand-fold higher capacity in 5G systems has brought 
to the forefront a promising technique with numerous advan¬ 
tages, known as massive MIMO, where the base station (BS) 
includes a very large number of antennas 0. The research 
on massive MIMO has been approached mostly by applying 
tools from large random matrix theory such as the Silver- 
stein’s fixed-point equation and the technique of deterministic 
equivalents a-iu. However, most works in conventional and 
massive MIMO have been based on the strong assumption of 
using perfect hardware in the radio-frequency (RF) chains. 

Indisputably, in practical systems, numerous detrimental 
effects such as I/Q imbalance ||8l and high-power amplifier 
nonlinearities 0, appear and result to the degradation of the 
performance of MIMO systems. Despite the effort for mitiga¬ 
tion of the arising impairments by application of calibration 
schemes at the transmitter and/or compensation algorithms at 
the receiver ifTOl . residual distortions remain because of several 
reasons. For example, imperfect parameters estimation and 
inaccurate models prove to be incapable to hinder the total 
infliction of the system’s performance. Not to mention that 
the cost-efficiency of the suggested for 5G massive MIMO 
technology rests on the application of inexpensive hardware, 
which will make the deleterious effect of the residual impair¬ 
ments more pronounced. 

Disregarding the importance for study of the effects of 
the residual transceiver impairments, the number of relevant 


works is limited. For instance, experimental results modeling 
the residual hardware impairments at the transmitter and 
the study of their impact on certain MIMO detectors such 
as zero-forcing took place in in. Regarding the channel 
capacity, ca elaborated on the derivation of high signal-to- 
noise ratio (SNR) ceilings by considering only transmitter 
impairments, while in ifTSl the authors extended the analysis 
to arbitrary SNR values, but most importantly, by including 
receiver impairments as well. Moreover, the authors in M 
considered this kind of impairments in dual-hop (DH) amplify- 
and-forward (AF) relay systems, which have attracted a lot of 
attention recently due to their performance benefits in terms of 
coverage extension, spatial diversity gains, etc. Ga. Unlikely, 
they considered only the outage probability and some simple 
capacity upper bounds in the simplistic case of single antenna 
systems. However, a thorough analysis of the capacity of 
relay systems in the case of multiple antennas lacks from the 
literature. 

This work covers the arising need for the assessment of 
the impact of the residual hardware impairments on the 
capacity of DH AF systems, when their size becomes large 
in terms of number of antennas and users. In fact, to the 
best of our knowledge, this is the first paper which studies 
the effect of residual impairments in relay systems with 
multiple antennas. Specifically, we present a new insightful 
expression for the ergodic capacity of DH AF systems under 
the presence of residual hardware impairments for arbitrary 
SNR values. Compared to the existing literature, we pursue 
a free probability (FP) analysis a, m, which requires 
just a polynomial solution instead of fixed-point equations, 
and provide a thorough characterization of the impact of the 
residual transceiver impairments on the capacity of DH AF 
systems in the large system limit. 

The remainder of this paper is organized as follows: Section 
im presents the system model of a DH AF MIMO system 
with residual hardware impairments. Section HIJ provides the 
theoretical analysis for the ergodic capacity of the considered 
system, while Section |IV] presents asymptotic capacity ex¬ 
pressions. Subsequently, Section |V] evaluates the performance 
of the considered system with the help of numerical results. 
Finally, Section [VT] concludes the paper. Appendices include 
some preliminaries on random matrix theory and certain 
proofs. 

H. System Model 

Suppose an ideal DH AF relay channel with K single 
antenna non-cooperative users, desiring to communicate with 


a distant A^-antennas BS by first contacting an intermediate 
relay including an array of M antennas (first hop). In other 
words, a single-input multiple-output multiple access channel 
(SIMO MAC), i.e., users-relay, is followed by a point to point 
MIMO channel (relay-BS). The BS is assumed to be aware 
of the total system channel state information (CSI) and the 
statistics of the distortion noises, while both the users and the 
relay have no CSI knowledge during their transmission. The 
received signals by the relay and the BS are expressed as 


yi=Hixi-fzi, ( 1 ) 

y 2 = H 2 v^yi -I- Z 2 

= i/r'H2HiXi -b v^H2Zi -b Z2, (2) 

where ([T]i and (|2|i describe the users-relay and relay-BS input- 
output signal models, respectively. Specifically, yi and y 2 as 
well as Zi ~ CN{Q,1m) and Z 2 CA/'( 0 ,lAr) denote the 
received signals as well as the additive white Gaussian noise 
(AWGN) vectors at the relay and BS, respectively. Both chan¬ 
nels representing the two hops assume Rayleigh fast-fading 
channels, expressed by Gaussian matrices with independent 
and identically distributed (i.i.d.) complex circularly symmet¬ 
ric elements. Hence, Hi G ^ CA/'(0 ,Im <8 I/c) is the 

concatenated channel matrix between the K users and the relay 
exhibiting flat-fading, while H 2 G {[^nxm ^ CA/'(0, Iat 0 Im) 
describes the channel matrix of the second hop. In addition, 
Xi G is the Gaussian vector of symbols simultaneously 

transmitted by the K users with E [xix”] = Qi = , i-e., 

the individual signal-to-noise-ratio (SNR) equals to p = 
Note that before forwarding the received signal yi at the relay, 
we have assumed that it is amplified hy v = M(i+p) ’ where 
we have placed a per relay-antenna fixed power constraint 
i,e., E [llv^yilP] ^ where the expectation is taken over 
all random variables. 

Unfortunately, in practice, the transmitter, the relay, and the 
BS appear certain inevitable impairments such as I/Q imbal¬ 
ance 00 ). Although, mitigation schemes are incorporated in 
both the transmitter and the receiver, residual impairments still 
emerge by means of additive distortion noises Oni, ED. Tak¬ 
ing this into consideration, in each part of the system a transmit 
and/or receive impairment exists that causes: 1 ) a mismatch 
between the intended signal and what is actually transmitted 
during the transmit processing, 2 ) and/or a distortion of the 
received signal at the receiver side. 

Introduction of the residual additive transceiver impairments 
to E) and (ID provides the more general channel models for 
the respective links 

yi=Hi (xi-bJytJ+rjrj-bzi, (3) 

y 2 =H 2 (v^yi+T7t2)+I7r2 +Z 2 

= V^H2Hi(xi-bJ7ti)-l-H2(v^(j7ri-bZi)-bJ7t2)+I7r2+Z2, (4) 

where the additive terms r/u and rj^i for i = 1,2 are the 
distortion noises coming from the residual impairments in the 
transmitter and receiver of link i, respectively. Interestingly, 
this model allows to quantify the impact of the additive 
residual transceiver impairments, described in EHl, ED, on 
a DH AF system. Generally, the transmitter and the receiver 
distortion noises for the ith link are modeled as Gaussian 
distributed, where their average power is proportional to the 


average signal power, as shown by measurement results ED- 
Mathematically speaking, we have 

rjt, CAf{0, ^t.diag (gi,,..., qr,)), (5) 

Tjr, CM{0, tr (Qi) I/jj) ( 6 ) 

with Ti and R-, being the numbers of transmit and receive 
antennas of link i, i.e., Ti = K, T 2 = M and Ri = 
M, i ?2 = N, while Qi is the transmit covariance matrix 
of the corresponding link with diagonal elements ... ,qT,. 
Moreover, 5^. and 5^. are proportionality parameters describing 
the severity of the residual impairments in the transmitter and 
the receiver of link i. Especially, in practical applications, these 
parameters appear as the error vector magnitudes (EVM) at 
each transceiver side ED- Obviously, as far as the first hop is 
concerned, the additive transceiver impairments are expressed 
as 

(7) 

( 8 ) 

Given that the input signal for the second hop is y^yi, the 
corresponding input covariance matrix is 

Q2 = i/E [yiy)'] =vk(^p. + -b Im 

= (IvKIm, ( 9 ) 

where /i = (/r -b + -^). Note that now, v = 

after accounting for fixed gain relaying. Thus, the additive 
transceiver impairments for the second hop take the form 

rjt, ( 10 ) 

Vr, - CAfiQ, SIpuKMIn). (11) 

III. Ergodic Capacity Analysis 


The capacity per receive antenna of this channel model is 
given by the following lemma, which takes (ID into account. 

Lemma 1: The capacity per receive antenna of a DH AE 
system in the presence of i.i.d. Rayleigh fading with residual 
additive transceiver hardware impairments under per user 
power constraints [Qi]fc fc < Vfc = 1... AT and (ID is given 
by 


= —E 
N 


In det 
In det ( 


(l^ + ^H2HiHf Hf $ 
$ + ^H2HiHfHf)' 

V ^ 

Cl 



- ;^E[lndet($)], 

V 

C2 


( 12 ) 


(13) 


where $ = / 2 H 2 HiH;H" -b / 3 H 2 H" -b Iat with B = 

SlfiuKM + 1, /i = /2 = h5l, h = 

Proof: Given any channel realizations Hi,H 2 and trans¬ 
mit signal covariance matrices Qi and Q 2 at the user and relay 
sides, a close observation of dD shows that it is an instance of 













the standard DH AF system model described by (O, but with 
a different noise covariance given by 

$ = r/j2^H2Hidiag (gi,,. ..,qK) 

+ H 2 Qi + Iw + I^<5t2diag (gii,..., qm)) H 2 

+ tr Q 2 + 1 ) Ia^- (14) 


Taking into account for the optimality of the input signal xi 
because it is Gaussian distributed with covariance matrix Qi = 
-^Ik, the proof is concluded. ■ 

Based on Lemma [T] we are able to investigate the impact 
of the additive transceiver impairments on DH AF systems in 
the case of infinitely large system dimensions. 

Remark 1: Despite the resemblance of the ergodic capacity 
with transceiver impairments, given by (fT^ . with the conven¬ 
tional ergodic capacity of a DH AF system ifTSl Eq. 2], this 
paper shows the fundamental differences that arise because the 
noise covariance matrix now depends on the combination of 
the channel matrices Hi, H 2 . 

Employing the property det(I+AB) = det(I+BA), Ci, C 2 
can be alternatively written as 

Ci = lE[lndet(lM + / 3 H»H 2 (lM + /iHiH«))] (15) 

m + ^HiH 

h 

IV. Asymptotic Performance Analysis 

This section presents the main results regarding the system 
performance in the large-antenna regime. Nevertheless, we 
account also for the scenario, where the number of users 
increases infinitely. Given that our interest is focused on chan¬ 
nel matrices with dimensions tending to infinity, we employ 
tools from large RMT. Among the advantages of the ensuing 
analysis, we mention the achievement of deterministic results 
that make Monte Carlo simulations unnecessary. Moreover, the 
asymptotic analysis can be quite accurate even for realistic 
system dimensions, while its convergence is rather fast as the 
channel matrices grow large. Thus, after defining ^ and 
J the channel capacity of the system under study is 

given by the following theorem. 

Theorem 1: The capacity of a DH AE MIMO system in 
the presence of i.i.d. Rayleigh fading channels with additive 
transceiver impairments, when the number of transmit users K 
as well as relay and BS antennas (M and N) tend to infinity 
with a given ratio, is given by 



C2 = -E 


Indet (IM + / 3 H 2 


"H 2 


C->--[ ln(l-f/ 3 Mx)(/^ ,^(a;))da;, (17) 

7 Jo \ 7? / 

where the asymptotic eigenvalue probability density functions 
(a.e.p.d.f.) fKj u^/M obtained by the imag¬ 

inary part of the corresponcfing Stieltjes transform S for real 
arguments. 

Proof: See Appendix [B] ■ 


V. Numerical Results 

In order to validate our theoretical analysis, Eig.[T] provides 
the a.e.p.d.f. of Kq,/M given by (l30l) . In particular, the 
histogram represents the p.d.f. of the matrix Kq/M calculated 
numerically based on Mote Carlo (MC) simulations. Further, 


the solid line denotes the a.e.p.d.f. obtained by solving the 
polymonial (l39l l for Stieltjes transform, and then applying 
Lemma 4. From the result, we can observe a perfect agreement 
between the results obtained from theoretical analysis and MC 
simulations. 



X 


Fig. 1. A.e.p.d.f. of \^a/M (/i = = 20 dB, /3 = 5, 7 = 10, Af = 100, 

M = 10, K = 50) 


In Fig. |2] we plot the theoretical and simulated per-antenna 
ergodic capacities versus the transmit SNR, i.e., /r for the 
following two cases: (i) without impairments, and (ii) with 
impairments on transmitter and receiver of both links. From 
the figure, it can be noted that theoretical and simulated 
capacity curves for both the considered cases match perfectly. 
Furthermore, the per-antenna capacity increases with the in¬ 
crease in the value of /r in the absence of impairments, i.e., 
5ti = < 5*2 = = 6 r 2 = 0 as expected. Moreover, the most 

important observation is that the per-antenna capacity saturates 
after a certain value of p in the presence of impairments. The 
trend of per-antenna capacity decrease with respect to p, in Fig. 
| 2 ] is well aligned with the result obtained in iTOl for the case 
of MIMO systems. However, for the considered scenario in 
this paper, an early saturation of the capacity in the presence 
of impairments is noted due to the introduction of the relay 
node impairments. Nevertheless, in Fig. |2] we also illustrate 
the effect of different values of impairments on the capacity 
considering the values of = 5t^ = 5ri = ^ 

0.01, 0.08 and 0.15. Specifically, it can be observed that with 
the increase in the value of impairments, the saturation point 
appears earlier, i.e., at lower values of p. 

Figures |3(a)| and |3(b)| present the per-antenna capacity 
versus SNR levels p, v in the presence and the absence 
of impairments, respectively. It can be observed that in the 
absence of impairments, the capacity increases monotonically 
with both p and v, with the slope being steeper for the case of 
p. However, in the presence of impairments, clear saturation 
points can be noted with the increase in the values of p and 
V after certain values. 

As far as Figs. |4(a)| and |4(b)| are concerned, we plot the per- 
antenna capacity versus the channel dimensions 7 and /3 in the 
absence and the presence of channel impairments, respectively. 
In both cases, the capacity increases monotonically with both 
/3 and i, however, the slope with respect to i is steeper as 












































Fig. 2. Per-antenna ergodic capacity versus fi {u = 20 dB, /3 = 5, 'f = 10, 
N = 100, M = 10, K = 50, St^ = St2 = ^ri = 




Fig. 3. Per-antenna ergodic capacity versus SNR levels /r, i/ (/3 = 5, 7 = 10, 
N = 100, M = 10, K = 50, (a) <5ti = = -Sri = < 5^2 = 0, (b) 

<5ti = &t2 = <5ri = <5r2 = 0.08) 

compared to the slope with /3. This trend remains almost the 
same in the presence of impairments, but the slope of the 
capacity curve with respect to ^ in Fig. |4(b)| is observed to 
be less steeper than in Fig. |4(a)| at higher values of i. 

VI. Conclusions 

This paper presented a thorough investigation of the impact 
of residual additive hardware impairment on the ergodic capac- 




Fig. 4. Per-antenna ergodic capacity versus channel dimensions /3, 7 (^ = 
P = 20 dB, (a) Sti — ^t 2 — — 5r2 — 0, (b) — ^t 2 — — ^r 2 — 

0.08) 

ity of DH AF MIMO relay channels by considering a large 
system analysis. Specifically, we derived the ergodic capacity 
by employing the theory of FP. Moreover, we proceeded with 
the study of the effects of hardware impairments, when the 
number of antennas becomes large as massive MIMO archi¬ 
tecture demands. Notably, we demonstrated the quantification 
of the degradation due to the additive RF impairments on 
the ergodic capacity by varying the system parameters such 
as the SNR, the number of antennas, and the quality of the 
RF equipment. Nevertheless, the validation of the analytical 
results was shown by means of simulations. In particular, sim¬ 
ulations depicted that the asymptotic results can be applicable 
even for contemporary system dimensions. 


Appendix A 
Useful Lemmas 

Herein, given the eigenvalue probability distribution func¬ 
tion f:x.{x) of a matrix X, we provide useful definitions and 
lemmas, found in lfT9l , that are considered during our analysis. 
In the following definitions, 5 is a nonnegative real number. 

Definition 1 (Shannon transform H19\ Definition 2.12]): The 
Shannon transform of a positive semidefinite matrix X is 

















defined as 


Vx(^)= / \n{l + Sx) fx{x)dx. (18) 

Jo 

Definition 2 (rj-transform H19\ Definition 2.11]): The rj- 
txansform of a positive semidefinite matrix X is defined as 

Definition 3: [S-transform lfT9l Definition 2.15]] The S- 
transform of a positive semidefinite matrix X is defined as 

^x(a^) = + 1 ). ( 20 ) 

X 

Definition 4 (The Marcenko-Pastur law density function 
Given a Gaussian K x M channel matrix H ^ 
CA/'(0,I), the a.e.p.d.f. of converges almost surely 

(a.s.) to the non-random limiting eigenvalue distribution of the 
Marcenko-Pastur law given by 


,HH» 


(x) = (l-/3)+(x)-h 


\l{x-a)'^ {b-xY 

2 'kx 


( 21 ) 


where a = (1 — \/^)^, 6 = (1 -I- \/?)^, and <5 (x) is 

Dirac’s delta function. 

Lemma 2 ( HVl Eqs. 2.87, 2.88]): The S-transform of the 
matrix H"H is expressed as 

ix,l3) = ( 22 ) 


while the S-transform of the matrix -^HH^ is obtained as 
SiHH" ^ 2 ; ■’ 

Lemma 3 ( m Eq. 2.48]): The Stieltjes-transform of 
a positive semidefinite matrix X can be derived by its p- 
transform according to 


Sy.{x) = 


>?x(-lA) 

X 


(24) 


Lemma 4 ( ( 1791 Eq. 2.45]): The a.e.p.d.f. of X is obtained 
by the imaginary part of the Stieltjes transform S for real 
arguments as 


./x(^) 


lim ia{5x(a: + j?/)} . 

y^ 0 + TT 


(25) 


Appendix B 
Proof of Theorem[T| 

The asymptotic limits of the capacity terms (fTSl l and (fThl l. 
when the channel dimensions tend to infinity, while keeping 
their ratios (3 and 7 fixed, are expressed by means of principles 
of FP theory in terms of a generic expression as 

Ci = 2^ E[Indet (Im + /sHf H2(Im + aHiHf ))] 

Tgl„(l + /3MA, (iK„)) 

-f Ml + fsMx) f^^/M{x)dx, (26) 


M , 

— lim E 

N K,M,N^oo 


where corresponds to Ci or C 2 depending on the value of i, 
i.e., if a = /i orif a = f 2 /fs, respectively. In addition, Xi (X) 
is the ith ordered eigenvalue of matrix X, and denotes the 
asymptotic eigenvalue probability density function (a.e.p.d.f.) 
of X. Moreover, for the sake of simplification of our analysis, 
we have made use of the following variable definitions similar 

to mi 



— Ijv/ + crHiH^ 

(27) 

Ni 

= HiH; 

(28) 

N 2 

= H»H2 

(29) 


= H^H2 (Im + aHiHf) = N2M„. 

(30) 


The a.e.p.d.f. of Kq/M can be obtained by means of 
Lemma |4] which demands its Stieltjes transform. In the 
following, we describe the steps leading to the derivation of 
the desired Stieltjes transform of K.^/M. First, we employ 
Lemma 12 and take the inverse of p-transform of Jia/M as 

(^)) L 1 0 . (31) 

Thus, we now focus on the derivation of /m (^)- 

Proposition 1: The inverse p-transform of K^/M is given 
by 


(32) 

Proof: The inverse of the ? 7 -transform of K^/M is given 
by means of the free convolution 





where we have taken into advantage the asymptotic freeness 
between the deterministic matrix with bounded eigenvalues 
N 2 /-W and the unitarily invariant matrix Mq,/M. Note that 
in (iSJt . we have applied Definition [3 Appropriate change of 
variables, i.e., y = x + 1 provides eq. (i32l l. ■ 

In order to obtain (x), we first need its a.e.p.d.f., given 

by the next proposition. 

Proposition 2: The a.e.p.d.f. of Mq,/M converges almost 
surely to with a = Ma. 

Proof: By denoting z and x the eigenvalues of Ma/M 
and j^Nr^ respectively, the a.e.p.d.f. of Mq,/M can be 
obtained after making the transformation z(x) = (1 -|- Max) 
as 


POO 


(^) 


1 

z'{z~^{x)) 


■tiN. (*-(»^)) 


L 



(35) 


Consequently, we are ready to obtain 77 ^^^ 
ing ( fT9] l. 

Proposition 3: The inverse p-transform of Ma/M is given 
by (E). 

















( 34 ) 


J (x — \ — a + 2a\f]5 — aj3) (a + 2a\f]5 + ajS — a; + l) 



{ rfc 

(36) 

/ic|=iC((l + m + VPiC + 1))(C(1 + ^(1 + a + + + 1)) 


- Pa+a—l+^yx'^a‘^+2xa‘^|3 — 2xa‘^ — 2xa+|3'^a‘^ — 2|3a'^ + 2|3a+a'^ + 2a+l 

(37) 


2xa 


Proof: Having obtained the a.e.p.d.f. of M^, use of 
Definition 12] allows to derive its ry-transform as 

/.+00 

If we make the necessary substitution, r]-^ /m ('*(’) written 
as in (l3^ . Following a similar procedure as in ll22ll . we 
perform certain substitutions. Specifically, we set x = wa + 1, 
dx = adw, followed by w = 1 + /3 + 2y/Pcosoj, dw = 
2^/P{— shiui)dui, and finally C, = dC, = iCduj. Hence, 
initially we calculate the poles Q and residues pi of Eq. (1^ . 
Then, we perform an appropriate Cauchy integration by includ¬ 
ing the residues located within the unit disk. More concretely, 
we have 

’Im„/m(V’) = ~^(Po + P2 + Pa), 

which after inversion results to Eq. dJTl l. ■ 

As far as E-f^^^j^{x) is concerned, it is given by (I23I) as 

^N2/m(2^) = 

In the last step, having calculated -q^ (x) from (l32T i after 
substituting (iJTT i and (l38T l, we employ ( Bil l, and after tedious 
algebraic manipulations we obtain the following quartic poly¬ 
nomial 

+ (26?(l - 7)a; -b 

+ (a^(2 - /3 - 7)x -b a^(7 - 1)^ - ax)S'^^/j^ 
-b(a^(/3(7 - 1) - 7 ) + a(7 + a-x- 1)-S'k„/m - a. (39) 
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